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Abstract — Communication nodes with the ability to harvest 
energy from the environment have the potential to operate beyond 
the timeframe hmited by the finite capacity of their batteries; and 
accordingly, to extend the overall network lifetime. However, the 
optimization of the communication system in the presence of 
energy harvesting devices requires a new paradigm in terms of 
power allocation since the energy becomes available over time. 
In this paper, we consider the problem of two-hop relaying in 
the presence of energy harvesting nodes. We identify the optimal 
offline transmission scheme for energy harvesting source and 
relay when the relay operates in the full-duplex mode. In the 
case of a half-duplex relay, we provide the optimal transmission 
scheme when the source has a single energy packet. 

I. Introduction 

Recent advances in energy harvesting technologies enable 
self-sustaining wireless nodes that are not limited by the life- 
time of a battery. However, identifying the optimal operation 
of the network with energy harvesting nodes is not a trivial 
problem and is significantly different from the network lifetime 
maximization problem in the case of battery limited nodes. 
The optimal operation of the nodes depends highly on the 
energy harvesting profile while satisfying the energy-neutral 
operation [l], which limits the amount of energy that can be 
used up to time t by the total harvested energy until that 
time. This problem has received a lot of interest recently, 
and several works concerning the optimization of different 
network utility functions with various assumptions on the 
available information about the energy profiles of the nodes 
have appeared in the literature fTl|-|l6|. 

The problem of minimizing the transmission time for a 
given amount of data over a point-to-point link with energy 
harvesting is introduced in f2|. This problem is the dual to 
the problem of maximizing the total amount of data that 
can be transmitted within a deadline constraint, which in 
turn is closely related to the problem of scheduling packets 
to minimize the total transmission energy studied in |7|, 
m. Optimal transmission in an energy-harvesting system is 
considered in |3| when the transmitter has a limited battery 
size. In [6| a general framework including continuous energy 
harvesting as well as various battery limitations is provided to 
optimize the transmission scheme. 

This paper studies two-hop transmission in the case of 
energy harvesting nodes. We focus on a two-hop network com- 
posed of an energy-harvesting source, an energy-harvesting 
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Fig. 1. Illustration of the two-hop system model with energy-harvesting 
source and relay terminals. 



relay and a destination. The energy harvesting process at each 
node is modeled as a packet arrival process, such that each 
energy packet of a random amount arrives at a random time 
instant. Our focus will be on offline algorithms, that is, the 
instants and the amounts of random energy packet arrivals 
are assumed to be known. Given a deadline constraint of T, 
our goal is to maximize the total amount of data that can be 
transmitted to the destination within time T. The problem, 
and the difficulty of the solution differs significantly for a 
full-duplex and half-duplex relay. While the instantaneous 
transmission power of each terminal over time is to be 
optimized in both cases; in the case of a half-duplex relay, 
the transmission schedule between the source and the relay 
needs to be optimized as well. 

II. System Model 

We consider a two-hop network consisting of a source, a 
relay and a destination (see Fig. [TJ. We study the transmission 
over a time period of T. Within time T both the source and 
the relay harvest energy at known instants of known amounts. 
Let Q — ti < t2 < ■ ■ ■ < denote the energy harvesting 
instants at which the source harvests energy of amounts 
Ef, . . . ,Ef^, respectively, while the relay harvests energy of 
amounts E'^, . . . , E^, respectively. While we assume identical 
energy harvesting instants for both nodes; this model is general 
enough as the time instants at which only the source harvests 
energy can be modeled by setting E^^ = 0, or vice versa. 
We assume no constraint on the battery sizes. Note here 
that, different from the previous models we have an energy- 
harvesting receiver: the relay. While it is interesting to consider 
the effect of receive energy in this model, our focus in this 
work is only on the energy used for transmission. 

Both the source and the relay can adapt their transmission 
power and rates instantaneously. We assume additive white 
Gaussian noise (AWGN) channels from the source to the 
relay, and from the relay to the destination. Let hg denote 



the channel coefficient from the source to the relay, while 
hr denote the channel coefficient from the relay to the des- 
tination. The noises at the receivers are assumed to be unit 
variance and independent of each other The instantaneous 
transmission rate from the source to the relay is given by 
r^(P''(t)) ^ 5log(l + hsP^t)) where P''(i) is the source 
power allocated for transmission to the relay at time t. Sim- 
ilarly, the rate function from the relay to the destination is 
given by r''{P''{t)) = \ log(l + KP^'it)) where P''[t) is the 
power of the relay at time t. 

The set of feasible power allocation functions at the source 
and the relay is defined as follows. 

V = ^{P%t),P^{t)) : < P=(t),P'-(t),v t e [0,T], 
/ P\t)dt< Y^El and 

/ P"(f)df < V Pi; for alHG 

^ r''[P''{r))dT< r\P'{T))dr VfG[0,r]|. (1) 

While the first two conditions are due to the causality of 
energy, the last condition is due to the causality in the bits 
transmitted by the relay; that is, bits can only be transmitted 
from the relay after they have arrived from the source. 

The goal is to characterize the maximum number of bits B 
that can be transmitted to the destination at the end of time 
T for given energy arrival profiles at the source and the relay. 
For the solution of this two-hop problem, we often refer to the 
optimal transmission policy in a single-hop system. As pointed 
out in |6|, the optimal transmission policy for the single-hop 
setup, which we call the Max-Bit algorithm, can be derived 
similarly to the dual results in Q, E|. 

III. Full-duplex Relay 

We first consider the case with a full-duplex relay. The 
optimization problem can be written as follows. 

max ( r''{F'{t))dt 
Jo 

s.t. {P'{t),P'-{t)) eP. 

The energy profile at the source limits the bits that can 
be transmitted to the relay over time. On the other hand, the 
bits transmitted by the source form a bit arrival profile at the 
relay. The relay tries to forward as many of its received bits 
as possible to the destination within time [0,T], satisfying the 
causality constraints for both the bits and the energy packets. 
Note that, at the source terminal, the objective function to be 
optimized is not the total number of bits that can be transmitted 
by time T as in the single-hop problem in [21 and |6J. For 
example, when the number of bits the source transmits to the 
relay is not the bottleneck, potentially, it is possible for the 
source to transmit less bits in total, while achieving a different, 
more advantageous bit arrival profile at the relay, such that the 



relay can forward more of these bits to the destination. In the 
following lemma, we show that this is not the case. 

Lemma 3.1: For given energy arrivals Ef, . . . , Ef^ at the 
source, the optimal source transmission scheme is the one that 
maximizes the total number of bits transmitted to the relay by 
time T. Hence, the optimal transmission scheme is given by 
the Max-Bit algorithm. 

Proof: Let P^(i) be the power allocation scheme given 
by Max-Bit algorithm that maximizes the number of bits 
transmitted to the relay at time T. Let and B^it) be the 

corresponding cumulative transmitted energy and bit profiles, 
respectively. That is, we have E^it) = y^P''{T)dT and 
B^'it) = /g r''{P^{T))dT. We know that P'{t) is a piecewise- 
linear, non-decreasing function that can increase only at energy 
arrival instants f2|. We want to show that any other power 
allocation profile P* [t] leads to a less advantageous bit arrival 
profile at the relay. 

Note that is a piecewise-linear increasing function, 

changing its slope at time instants, say, ii = 0, . . . ,tc-i,ic- 
In order to maximize the number of bits the relay forwards 
to the destination for this bit arrival process under its energy 
arrival profile, we adapt the algorithm given in [2J for the 
scenario when both the data and the energy arrives in packets. 
In the optimal transmission scheme given by this algorithm, 
the relay transmits at the highest possible transmission power 
its energy and bit arrival profiles allow. 

Let the transmission scheme P*(t) at the source have a 
transmitted bit profile B^{t). Consider the bit arrival profile 
P^(t) such that B''{t) = B^U) for iVi < t < U, i = 
2, . . . , c. We basically let the bits within each interval i^+i) 
arrive at the beginning of the interval. This can only increase 
the number of bits the relay can forward. Since P^(i) is a 
piecewise linear step function, the algorithm in |2) will give 
the optimal relay transmission scheme corresponding to it. 

We have B^it) < B'{t) at t = since P'{t) 

transmits the maximum possible number of bits at time instants 
of power increase. Now, if we compare the optimal schemes 
at the relay for B''{t) and B^{t), the former will always have 
a higher degree of freedom since it allows higher rates at the 
relay; and hence, forward more bits to the destination. ■ 

The maximum number of bits that can be transmitted to the 
destination can be determined as follows: the source transmits 
the maximum number of bits that is allowed by its energy 
arrival profile ignoring the energy profile of the relay, i.e., we 
use the Max-Bit algorithm at the source. Then the relay, using 
the bit arrival profile based on source transmission and its 
own energy arrival profile, forwards as many of these bits as 
possible to the destination. The optimal transmission scheme 
at the relay can be derived similarly to the algorithm described 
in |l2] for a point-to-point system, although the problems 
are slightly different: here, we have continuous data arrival, 
rather than in packets, and the goal is not to minimize the 
transmission time for given data and energy arrivals, but to 
maximize the number of bits by a given deadline. We do not 
go into the details of the algorithm due to lack of space. 



IV. Half-duplex Relay 

In the case of a half-duplex relay, we need to optimize the 
transmission schedule as well as the transmission power of the 
terminals, that is, in addition to the feasibility conditions for 
the power allocation functions given in ([1]), we also have to 
satisfy P'{t) ■ P''{t) = for all t G [0,T]. 

The problem is significantly harder in the case of a half- 
duplex relay. For a fixed transmission schedule between the 
source and the relay, the source does not necessarily use the 
power allocation scheme that maximizes the number of trans- 
mitted bits to the relay at the end of its transmission period. 
Consider the following example. Both the source and the relay 
receive energy packets of E units at time t = Q. Let T = 5t for 
some t > 0. The source is scheduled to transmit at intervals 
[0,t) and [2t,4:t), while the relay is scheduled to transmit at 
intervals [t, 2t) and [4i, bt). We assume r^{p) — r'^{p) — r{p). 
Overall, the source transmits over a time period of 2>t. The 
transmission scheme that maximizes the bits transmitted to 
the relay allocates a constant power of E/3t, and transmits 
t ■ r (■^) bits by time t, and 3t ■ r (■^) bits by time 4i. The 
relay on the other hand would optimally transmit at a constant 
power of E/2t; however, this would require a total of <-r (y) 
bits available at the beginning of time t, which is not the 
case. Accordingly, the relay transmits at a reduced power of 
E/Zt over the period [t,2t), and transmits at power 2E/3t 
over the period [At, 5t). Overall, the relay can forward a total 
of Bi ^ t ■ r (§) +t-r (^). On the other hand, if we 
let the source transmit at a constant power of E/2t over the 
periods [0,t) and [2t,3t) and remain silent rest of the time, 
it transmits 2i • r (^) bits to the relay by time T, which is 
less than the previous scheme. However, the relay can now 
transmit at power E/2t for a duration of 2t, and forwards a 
total of B2 2t ■ r (■^) bits. We have Bi < B2 due to the 
strict concavity of the rate function. 

To simplify the problem, we consider the case in which 
the source terminal receives a single energy packet of E at 
time t = 0. In general, we need to optimize the schedule 
between the source and the relay transmissions. We show for 
this special case that, in the optimal transmission schedule, 
first the source transmits a certain amount of bits using all its 
energy over a time period of < t < T, which needs to be 
determined, and then the relay forwards all the received bits 
to the destination in the remaining time period of T — t, using 
the optimal point-to-point transmission schedule. 

Lemma 4.1: In the optimal transmission schedule, the 
source transmits first and over a connected time interval, and 
then the relay forwards in the remaining time. 

Proof: Assume that P^{t) and P'^{t) are the optimal 
transmission power assignments for the source and the relay, 
respectively, such that P''[t) • P'~(t) = 0, V te [0,T]. Let 

t* ^ ( t{Ps{t) > 0)dt, (2) 
"'0 

where = 1 if a: holds, and otherwise. Now, define the 
power allocation function as the function that is obtained 



by shifting the nonzero portions of function {t) to left, that 
is, is nonzero only for t e [0,t*]. Similarly, we shift 

the nonzero portions of P'^{t) to right to obtain P^{t), which 
is nonzero only for t G Now, obviously these new 

functions both satisfy the energy causality constraints since 
the source has all the energy at time t — Q, and the relay is 
only postponing its transmission, and can store the available 
energy in its battery. On the other hand, the data causality is 
also satisfied, since the source is transmitting the same amount 
of data, but earlier than before, which can be stored in the data 
buffer of the relay. Hence, we do not lose by considering power 
allocation schemes that divide the time interval T to only two 
portions, first of which is allocated to the source while the 
second is allocated to the relay. ■ 

Note that this lemma is not valid when the source also 
harvests energy, since it might receive energy packets after 
time t* . Next lemma characterizes the optimal source and relay 
transmission schemes for given transmission schedule t* . 

Lemma 4.2: Let t* be the length of the source transmission 
period in the optimal transmission schedule. In this period, the 
source transmits at a constant power of E/t*, while the relay 
uses the optimal transmission strategy over time [t* , T] that 
maximizes the number of bits it transmits until time T, while 
at time t* it has energy X]m=i where m* is the maximum 
TO such that tjn < t*. 

Proof: The number of bits that can be forwarded to the 
destination in this scheme is the minimum of the number of 
bits the source can transmit to the relay up to time t* and the 
number of bits the relay can forward to the destination in the 
remaining time. The source can transmit at most t* • r** (p-) 
bits at constant power of E/t*. The maximum number of bits 
the relay can forward is found by the Max-Bit algorithm. ■ 

We do not have a closed form solution for the optimal 
transmission time of the source. Even in the case of a single 
energy packet at the relay, this requires the solution of a non- 
linear equation. However, since the number of transmitted 
bits from the source increases from zero to its maximum 
with increasing t, while the number of bits the relay can 
forward decreases from its maximum to zero, there is always 
an optimum transmission time t* G (0, T), which can be found 
numerically, that equates these values. While we can use the 
bisection method to find the crossing point of the optimal bit 
vs. transmission time curves of the source and the relay, it is 
possible to simplify the complexity of the algorithm as follows. 

Consider the energy arrival profile of the relay. See Fig. |2] 
for an example. On this plot, we denote the points cor- 
responding to the instants just before the energy arrivals 
by Ci, C2, . . . , Cjv, i.e., C,;, i = 2,...,N is the point 
Ej=l -Ej) . While Ci is the origin, the point correspond- 
ing to {T,^J^^ Ej) is denoted by Cn+i. We draw the lines 
connecting Cn+i to Cn,Cn^i, ■ ■ ■ ,Ci. Of these lines, we 
take the one that does not intersect the energy harvesting curve 
at points other than Ci's. Let the intersection of it with the a;- 
axis be ii. Among the CYs that this line intersects, we take 
the leftmost one, say Cj, and draw the lines from Cj to all 
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Fig. 2. The cumulative energy arrival profile at the relay. 
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Cfc such that k < j, and similarly to the previous step we 
determine t2, and so on so forth, until we reach Ci. Using 
the arguments for the optimal transmission scheme for the 
energy harvesting relay, if t* G [ti+i,ti), the optimal relay 
transmission curve first follows the straight line connecting t* 
to Cj which is the origin of the straight line that gave us 
and continuing on the straight lines drawn by the algorithm 
until we reach Cn+i- 

This algorithm gives us the maximum number of bits the 
relay can forward at each point in time. We can calculate this 
value for points ti,t2, ■ ■ ■ and compare them with the number 
of bits the source can provide to the relay up to that time 
instant, which is given by (1 — (^jzr^- stop, say 
at ti, when the value for the number of bits the relay can 
forward is more than the one the source can transmit. The 
optimal transmission time for the source t* lies between 
and ti-i. We use the bisection method in this range to find an 
accurate approximation of t*. 

For the sample energy arrival curve given in Fig. |2] we set 
El =5, E2 = 5, E3 = 6, t2 = 7, t3 = 10 and T = 11. We 
also fix the channel coefficients as hg ~ hr = 1. In Fig.[3j we 
plot the maximum number of bits that can be transmitted to the 
destination vs. the energy of the source. As illustrated in the 
figure with different colors, as the source energy increases, the 
optimal time allocation t* decreases, and it falls into different 
time intervals in the relay energy arrival curve. It can also be 
seen in the figure that the number of forwarded bits is bounded 
above by the maximum number of bits the relay can forward 
even if it had an unlimited bit supply. 

V. Conclusions and Future Work 

We have introduced the two-hop network model in which 
the source and the relay terminals are capable of harvesting 
energy from the environment. We have focused on the offline 
algorithms which optimize the transmission schemes with the 
knowledge of the energy harvesting profiles of all the nodes. 
We have provided the optimal transmission scheme in the 
case of a full-duplex relay. On the other hand, in the case 
of a half-duplex relay, characterizing the optimal transmission 
schedule in the most general case is quite complicated. Instead, 



Fig. 3. The maximum number of transmitted bits, B, versus the source 
energy, E" for the energy arrival profile given in Fig. |2] 



we have focused on the special case of a single energy 
packet at the source terminal. For this simplified scenario, we 
have identified the characteristics of the optimal transmission 
schemes at the source and the relay terminals, and we have 
provided a low complexity numerical algorithm that solves for 
the optimal transmission time schedule. 

An interesting extension of this work that deserves further 
analysis is the model with battery or data buffer limitations 
at the relay terminal. Note that, when the battery or the data 
buffer of the relay terminal is limited in the half-duplex case. 
Lemma 14.11 does not hold since either the energy or the 
data accumulated over the time period when the source is 
transmitting will overflow. Instead, we should optimize the 
transmission schedule taking into account the battery or the 
data overflow at the relay terminal. 
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